Papers with late interaction models
LI-RAGE: Late Interaction Retrieval Augmented Generation with Explicit Signals for Open-Domain Table Question Answering (2023.acl-short)
Copied to clipboard
| Challenge: | Recent open-domain TableQA pipelines use a combination of retriever and reader . a table can be very large and might contain heterogeneous information across rows/columns . |
| Approach: | They propose to combine a retriever-reader pipeline with a binary relevance token to train the retriever and reader. |
| Outcome: | The proposed approaches improve on two open-domain TableQA datasets. |
ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interaction (2022.naacl-main)
Copied to clipboard
| Challenge: | Neural information retrieval (IR) methods encode queries and documents into single vectors, but late interaction models produce multi-vector representations at the granularity of each token. |
| Approach: | They propose a retrieval method that couples an aggressive residual compression mechanism with a denoised supervision strategy to improve the quality and space footprint of late interaction. |
| Outcome: | The proposed retriever improves quality and space footprint of late interaction models while reducing space footprint by 6–10x. |